Web Survey Bibliography
This paper examines the issue of whether some respondents are consistently “bad” respondents, who use a variety of methods to get through a questionnaire quickly and provide data of dubious value. We examine a wide range of cognitive shortcuts, including choosing the first and last response options, yea-saying, giving don’t know and no opinion responses, nondifferentiation among answers to similar questions, reporting numerical answers as round values, and selecting status quo responses. Some of these are forms of survey satisficing but others are not. The data include responses from national face-to-face, telephone, and Web surveys. Across all three modes, we find little evidence that respondents who exhibit a high rate of shortcuts in the first half of a questionnaire also exhibit a high rate in the second half. In addition, we find weak correlations among the various forms of shortcutting. It could be that respondents have preferred modes for coping with the demands of survey questions, with some preferring DK responses, others non-differentiation, and still others yea-saying. Another possibility is that item characteristics (which affect how interesting and difficult an item is for different respondents) play a more important role in determining the level of shortcutting than respondent characteristics. A final possibility is that these shortcuts do not represent a single phenomenon, but are at best loosely related strategies for dealing with survey questions. We do not find consistent relations between any respondent variables (such as educational attainment) and any of our measures of the use of shortcuts.
Conference Homepage (abstract)
Web survey bibliography - Presser, S. (9)
- The Relations Among Different Cognitive Shortcuts in Surveys; 2013; Tourangeau, R., Medway, R., Presser, S.
- Question and Questionnaire Design; 2009; Krosnick, J. A., Presser, S.
- Social desirability bias in CATI, IVR and Web surveys: The effects of mode and question sensitivity; 2008; Kreuter, F., Presser, S., Tourangeau, R.
- Privacy, confidentiality, and response burden as factors in telephone survey nonresponse; 2008; Singer, E., Presser, S.
- Experiments Exploring the Relationship (or Lack Thereof) Between Nonresponse Error and Measurement Error...; 2008; Tourangeau, R., Groves, R. M., Presser, S., Toppe, C., Kennedy, K., Yan, T.,
- Experiments in Producing Nonresponse Bias ; 2006; Groves, R. M., Couper, M. P., Presser, S., Singer, E., Tourangeau, R., Piani Acosta, G., Nelson, Li.
- Methods for Testing and Evaluating Survey Questions; 2004; Presser, S., Couper, M. P., Lessler, J. T., Martin, E., Martin, J., Rothgeb, J. M., Singer, E.
- The science of asking questions; 2003; Schaeffer, N. C., Presser, S.
- Question & answers in attitude surveys. Experiment of question form, wording, and context; 1981; Schuman, H., Presser, S.